Self-supervised Graph-level Representation Learning with Adversarial Contrastive Learning

نویسندگان

چکیده

The recently-developed unsupervised graph representation learning approaches apply contrastive into graph-structured data and achieve promising performance. However, these methods mainly focus on augmentation for positive samples, while the negative mining strategies are less explored, leading to sub-optimal To tackle this issue, we propose a Graph Adversarial Contrastive Learning (GraphACL) scheme that learns bank of samples effective self-supervised whole-graph learning. Our GraphACL consists (i) encoding branch generates representations (ii) an adversarial generation produces samples. generate more powerful hard our method minimizes loss during updating maximizing adversarially over providing challenging task. Moreover, quality produced by is enhanced through regularization carefully designed divergence orthogonality loss. We optimize parameters alternately. Extensive experiments fourteen real-world benchmarks both classification transfer tasks demonstrate effectiveness proposed approach existing methods.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

GraphGAN: Graph Representation Learning with Generative Adversarial Nets

The goal of graph representation learning is to embed each vertex in a graph into a low-dimensional vector space. Existing graph representation learning methods can be classified into two categories: generative models that learn the underlying connectivity distribution in the graph, and discriminative models that predict the probability of edge existence between a pair of vertices. In this pape...

متن کامل

Time-Contrastive Networks: Self-Supervised Learning from Video

We propose a self-supervised approach for learning representations and robotic behaviors entirely from unlabeled videos recorded from multiple viewpoints, and study how this representation can be used in two robotic imitation settings: imitating object interactions from videos of humans, and imitating human poses. Imitation of human behavior requires a viewpoint-invariant representation that ca...

متن کامل

Semi-Supervised Learning with Generative Adversarial Networks

We extend Generative Adversarial Networks (GANs) to the semi-supervised context by forcing the discriminator network to output class labels. We train a generative model G and a discriminator D on a dataset with inputs belonging to one of N classes. At training time, D is made to predict which of N+1 classes the input belongs to, where an extra class is added to correspond to the outputs of G. W...

متن کامل

Learning Graph-Level Representation for Drug Discovery

Predicating macroscopic influences of drugs on human body, like efficacy and toxicity, is a central problem of smallmolecule based drug discovery. Molecules can be represented as an undirected graph, and we can utilize graph convolution networks to predication molecular properties. However, graph convolutional networks and other graph neural networks all focus on learning node-level representat...

متن کامل

Weakly-Supervised Learning with Cost-Augmented Contrastive Estimation

We generalize contrastive estimation in two ways that permit adding more knowledge to unsupervised learning. The first allows the modeler to specify not only the set of corrupted inputs for each observation, but also how bad each one is. The second allows specifying structural preferences on the latent variable used to explain the observations. They require setting additional hyperparameters, w...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: ACM Transactions on Knowledge Discovery From Data

سال: 2023

ISSN: ['1556-472X', '1556-4681']

DOI: https://doi.org/10.1145/3624018